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Foreword 


At the outset of this work, we hypothesized that charter school oversight structures made it difficult for 
charter schools with nontraditional models to open, operate, and flourish. We worried that the trend toward 
increasingly standardized authorizing practices would stymie the diversity of models in the charter sector 
and limit families’ choices. Over the past year, we have sought to understand whether these hypotheses 
were true and what could be done. Of course, the world looks very different today than it did when we 
commenced this work. 


Before the pandemic, the phrase “nontraditional school models” may have brought to mind Montessori 
schools, competency-based education, and dual-language programs. Today, the phrase is more likely to 
bring to mind virtual instruction, hybrid homeschooling, and learning pods. Moreover, few schools today are 
operating a “traditional” model. The pandemic is forcing educators, policymakers, and funders to 
fundamentally rethink how we sustain student learning in the midst of unprecedented disruption. 


The lessons and recommendations surfaced in our research are more salient than ever and will help 
authorizers, school leaders, and others navigate another school year in the midst of a pandemic. In addition 
to the resources we initially created as part of our work on nontraditional schools, we developed a 
complementary toolkit that translates our findings into concrete guidance for school leaders and authorizers 
in the current moment. 


In the short term, we hope this toolkit helps school leaders and authorizers collaborate on their approaches 
to sustaining learning over the coming weeks and months. And in the long term, we hope this collection of 

resources will inform how schools, authorizers, and others balance autonomy and accountability in service 
of creating a diversity of high-quality options for students and families. 
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This toolkit for school leaders is accompanied by a policy 
report and a toolkit for authorizers 


Standardized or 
Customized? 
school Authorizers Can Better 


Policy Report 


The policy report provides an 
analysis and detailed findings 
about the challenges and 
opportunities of authorizing 
nontraditional charter schools, 
with recommendations for 
authorizers, school leaders, 
funders, and policymakers 


This document 
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Authorizer Toolkit School Leader Toolkit 


The school leader toolkit 
outlines potential strategies for 
the leaders of nontraditional 
schools to use when they work 


The authorizer toolkit outlines 
potential strategies for 
authorizers to consider in their 
efforts to foster a diversity of 
high-quality options, with 
actionable templates, tools, and 
frameworks to guide their work 


with authorizers, including 
actionable templates, tools, 
and frameworks 
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Introduction 


The ability to foster a diversity of school options is an essential value proposition of the charter sector. The 
one-size-fits-all approach has had limited utility, and charter schools are well-positioned to provide options 
that meet a variety of student needs; also, in a country as large as ours, charter schools can accommodate 
a plurality of family preferences about the education they want for their children. Charter authorizers, 
meanwhile, have a mandate to ensure school quality, and their standard measures of quality can be in 
tension with the very nontraditional school models that school leaders and families are interested in. 


Authorizers and school leaders must work together to ensure schools are accountable for strong 
outcomes but not stymied from implementing nontraditional models. 


In the accompanying policy report, we identify authorizing practices that can disadvantage schools with 
nontraditional models and may artificially limit their ability to open and expand. In the toolkit that follows, we 
provide school leaders with a set of considerations, options, and tools to guide how they work with 
authorizers to address these challenges, ensure their schools provide high-quality options, and advocate 
on behalf of nontraditional models. We also provide parallel recommendations for authorizers in a separate 
toolkit. Our goal is to shed light on the importance of authorizing nontraditional charter schools and how the 
challenges of authorizing nontraditional schools manifest in practice, as well as to provide action steps for 
authorizers and school leaders who are able and eager to lead the field on these complex issues. 


Importantly, it is not our intent to provide an exhaustive list of all the scenarios that nontraditional schools 
and authorizers may face, nor to propose a “right” answer. Each school leader must consider the approach 
that makes the most sense given their constraints and local contexts. Rather, we hope this toolkit: 


e Informs school leaders about the authorizing challenges they may confront 
e Illustrates opportunities and options for school leaders to navigate the authorizing process 
e Shares useful frameworks for considering the benefits and trade-offs of these options 


Approach and methods (1 of 2): How do we define 
“nontraditional” schools? 


BMat-)ac-mr- lc: mr- Ad (e (Mc: 1 a=) 8’ me) meter a lele) Matteo (=) (Mall cM olctor-la Moll mr-lar-lhVc)CmUV i amente)com lat-lamr- Me ley4-lamce stele) 
models recently identified and defined by the National Association of Charter School Authorizers (NACSA): 


Diverse by design Classical “No excuses” Vocational Alternative/credit recovery Arts 
Special education Inquiry-based Early college Policy Gifted STEM 
International/foreign language Blended/hybrid Military Virtual Single sex 


A subset of models provides particularly useful illustrations. For clarity and consistency, we 
focus on three models that often present challenges for authorizers; we exclude other models entirely. 


We focus on: We exclude: 

e Inquiry-based schools: Revolve curriculum and practices around e Schools designed to serve specific 
students “learning by doing” (e.g., Montessori, Waldorf, Reggio Emilia, student populations, such as 
and Expeditionary Learning models) students with autism, overage and 

e Dual language immersion: Provide instruction in English and a target under-credited students, or students 
second language across subjects as a central component of their mission in foster care. These schools also 

e Competency-based schools: Provide students flexibility in how they experience misalignment with 
demonstrate mastery of a particular skill or subject, allowing them to standard authorizing practices, but 
advance their learning independent of time spent on a subject merit a separate, thorough analysis 


Source: National Association of Charter School Authorizers (NACSA), Reinvigorating the 
Pipeline: Insights into Proposed and Approved Charter Schools, 2019 6 


Approach and methods (2 of 2): How we identified the 
challenges nontraditional schools face with authorizing 


momo l(oMi(-M(ol-laiaiavaecxezavere)(-Mmedar-li(-vale(ct-mnUiaamr-lUitalelardlare ig 


To identify and understand how standard authorizing practices 
can create pain points for nontraditional schools, we reached 
out to our networks and solicited input from school leaders 
themselves. 


Ultimately, more than two dozen leaders of nontraditional 
schools shared specific examples of these challenges, as 
well as some of the strategies they have used to navigate 
them. 


We pressure-tested these challenges with staff from eight 
different authorizers and nine veterans of the charter sector. 
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Current situation: Nontraditional schools encounter 
challenges throughout five levers of the authorizing process 


Lever Challenges for nontraditional charter schools 


School leaders must do more than others to make a case for their model, since authorizers 
who are unfamiliar with the model may perceive it as risky 

Te) o) co) VZ-1 ME Tale| School leaders must assess whether standard performance metrics conflict with their school 
chartering model, or fail to capture their school’s distinct value 

School leaders may need to create new metrics, but often lack the expertise to do so 


WM eyatixeyatare| e School leaders may find standard metrics do not accurately reflect schools’ performance 
reviews e School leaders may be incentivized to adopt practices in conflict with their model 


School leaders may find performance on standard metrics more likely to put their schools on 
the cusp between renewal and closure 

High-stakes School leaders may find that rubrics for site visits and classroom observations are 
reviews misaligned with their schools’ instructional approaches 

School leaders with nontraditional program designs, which take more time to fully 
launch, may find they are disadvantaged during the school’s first high-stakes reviews 


School leaders may experience disadvantages in the expansion process, when 
authorizers base decisions on past performance on standard metrics 
e School leaders must do more to build the case for their model during expansion decisions 


-e School leaders may be disadvantaged in conversations with authorizers if the authorizer — 
Soft levers does not understand the model or why its performance may look different from other schools 


e School leaders may miss opportunities to highlight successes of their models 


Model 
expansion 


Individual challenges may seem small, but they accumulate. Ultimately, they limit the 


diversity of models available to students and families. 


Challenges & strategies: School leaders can advance 
their work with authorizers in three important ways 
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Metrics 
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Challenge 


Limitations in knowledge, 
expertise, time, and resources 
constrain how school leaders 
tailor their approach to 
engaging with their 
authorizers 


Authorizing performance 
metrics may be in conflict with 
or may not capture 
nontraditional school model’s 
value proposition 


Key stakeholders, including 
families, the community, and 
the authorizer, may not be 
familiar with nontraditional 
school models, their value, or 
why they present challenges 
for authorizing 


Strategies 


School leaders can 
strengthen access and 
effective use of data, and 
build authorizer awareness 
and knowledge of their 
specific models 


School leaders can develop 
and share valid and reliable 
metrics with their authorizer 
that demonstrate outcomes 
aligned with their school 
model’s bar of excellence 


School leaders can build trust 
and ongoing communications 
with families, the community, 
and the authorizer to 
proactively mitigate 
challenges 


Resources & Tools 


For each challenge, the 
toolkit provides: 


aS Description of 
challenges and 
strategies from the 
perspective of the 
school leader 


YY Tools, including 

A resources, frameworks, 
and considerations to 
support decision- 
making and to mitigate 
challenges 


Case studies, with 
sample approaches of 
how some school 
leaders are 
implementing 
strategies to address 
challenges 
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Intended outcomes: By addressing these challenges, school 
leaders can foster strong relationships with authorizers 


School leaders have the opportunity and responsibility to ensure that all students can flourish, 
that their schools are equally available to all families, and that their schools are able to 
achieve strong outcomes for the students they serve. In collaboration with authorizers, school 
leaders must navigate the tension between demonstrating quality against consistent 
standards while remaining true to the distinct value their models provide. This toolkit seeks 
to encourage and inform that work, and we offer recommendations for how school leaders and 
other stakeholders can work to find the optimal balance. Ultimately, this toolkit aims to support a 
charter sector in which more families have access to a diversity of high-quality options. 


Photos courtesy of Allison Shelley/The Verbatim Agency for American 
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school leaders can consider ways to build their own 
Capacity, as well as that of current or potential authorizers 


Capacity: Description 


Limitations in knowledge, expertise, time, and resources: 

Both the school leader and authorizer may experience challenges in capacity. School leaders 
may not know how to make a compelling case to the authorizer about the distinct value of 
their nontraditional school model. They may also lack the expertise or resources to 
develop alternative or additional performance metrics. This may not only make it more 
difficult for school leaders to get nontraditional models approved, it can also create 
challenges for nontraditional schools during other phases of the authorizing process. 


This can have at least five consequences: 


1. Authorizers may not know what nontraditional schools are, or their distinct value 

2. Authorizers may penalize, not approve, or non-renew schools whose quality is not 
fully reflected on standard performance metrics 

3. Authorizers may miss opportunities to encourage growth of high-quality schools 

Nontraditional schools may not have the opportunity to demonstrate excellence 

5. Families and communities may have more limited school options 


= 
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There are several strategies for how school leaders can 
build their capacity and that of potential authorizers 


To grow their capacity, school leaders can: 
(4) Build authorizer awareness of their model 
(2) Build data and evaluation expertise by: 
Investing in internal data capacity 
Collaborating on shared data resources 


(20) Leveraging expertise from partnerships and national associations 
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4) Build awareness: School leaders can be proactive in 
sharing the challenges some models often experience 


Capacity: Tools. —_—| BTeye) |S 


Models Example Challenges for More Common Nontraditional Models 


e Pacing of achievement: Since this model emphasizes language instruction in 
multiple subject areas in a target second language, students’ proficiency rates may be 
lower on standardized tests conducted in English, especially in elementary grades 


e Achievement in other languages: Schools may not be rewarded for achieving their 
goals of language proficiency in the target second language 


e Multigrade classrooms: For multigrade classrooms, schools may have varying 
numbers of students in actual grade levels. Individual grade enrollment may not 
reflect overall demand, or outcome data may not reflect overall performance 


e Alignment with rubrics: Observation rubrics that reward teacher-student 
interactions are in tension with instructional components that encourage uninterrupted 
student-directed learning 


e Technology proficiency: Schools that actively avoid technology in the classroom 
may face a challenge on state assessments that are administered on computers, 
regardless of students’ knowledge/proficiency 


e Seat-time requirements: State and authorizer requirements on hours of exposure to 
a subject or length of time in a class conflicts with models that measure students’ 

Competency- ability to master a topic in other ways independent of time or duration 

=F t-te" fele(- @ Learning progression: The sequence of instruction is different from other models, 

and therefore students may not learn the same content, in the same sequence, as is 

measured by standardized assessments 


DIUF-} i Mr-Tateier-\e(-) 
Models 


Inquiry-Based 


WV Foye (=1 k 
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4) Build awareness: School leaders can anticipate and 
respond to authorizers’ questions about their model 


Capacity: Tools —_| BTeye) |S 
School leaders can preempt common questions and leverage resources to respond 


Questions to Anticipate 


Is this school model in demand from families? How School Leader Resources 


= do you know? What other schools have this model? 


What are the distinguishing characteristics of the 
model? How do they support student success? 


Do you expect students in this model would achieve 
proficiency at a different pace than others? Why? 


If students are expected to achieve proficiency over a 
longer timeline, what is that timeline? 


Do you anticipate that students will learn content in a 
sequence different from that on state tests? Why? 


How do you measure student growth internally, to 
inform continuous improvement? 


Does the school model rely on a particular style of 
pedagogy? If so, what should authorizers look for 
when observing student-teacher interactions? 


=> 4 ol: at M aie: ey: la iCenelt-lae-ted aloe) maavere(-y| 
can consult with authorizer staff and 
make presentations to authorizer 

letey= Ice) 


Peer school leaders can share their 
experiences and share best practices, 
either formally or informally 


Authorizers who oversee schools with 
Teall relamaalore(=1(omer-lam elxe)’(e(omlarsiie alm aire) 
their own approach and experiences 


Partners who support the high-quality 
Tan} od(=1aat=yair=14(e)a me) mxeialele) im anlele(=)(omer- lal 
fe) gedvi(o(=mr- lalate (=) el-1ale(/aliceleiesi(e(-me)(er=) 


4) Build awareness: School leaders have several 
opportunities to build authorizer’s familiarity with the model 


Capacity: Tools —_—| Tools 


Where possible, school leaders should be proactive. It is easier to implement the 


strategies below prior to challenging conversations with the authorizer 


Objective of School Leaders 
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rakeyauuesleliite)at-]m-yey alele) maalete(=1 (>) 


BY=\V/-1 Co) oM-lalem-Jar-1e-M-] 0) elmer: (era) 


Com nit-y-l-Lelalaremareyalig-leliareyar-] 
rYoq aYoto) Mm el:]ace)euir-lalers 


Deepen authorizer’s 
Caen (exe fet-m-TalelKolmm at) elelale ve) 
FUL dato) a 4-1 mere) aler-) gat 


Strategies 


Describe differences between your school model and more 
traditional school models 

Invite authorizer to school events or tours that exemplify 
your school to understand how different models look (e.g., 
Describe program approach and rationale to ensure 
authorizer understands your instructional design (e.g., in 
ongoing communications, on school website, using videos, in 
annual report) 

Quantify outcomes of your school (e.g., family demand, 


Connect authorizer with third-party experts in the school 
model to speak with or consult the authorizing staff 

Share the perspective or voice of advocates, such as a 
families, alumni, or community members 


If an authorizer does not have the resources for the above investments, a school leader could 
look to partner with an authorizer that does* 


*Schools that transfer to other authorizers must be mindful of the potential that “authorizer shopping” is perceived as dodging accountability. See 


NACSA, “Ending Authorizer Shopping,” 2019. 
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Data & evaluation: Depending on available resources, 
school leaders can consider ways to build their capacity 


Capacity: Tools —_—| BTete) |S 


e Hire data analyst who can manage data, conduct 
analysis, and execute other internal data needs 
Invest in internal data e Contract with a measurement and evaluation expert 
capacity who can work with your school to develop metrics that are 
valid, reliable, and attainable indicators of the school 
model’s success 


More Resources 


e Collaborate with other schools (with the same model or 
with other nontraditional models) to share the cost and 
expertise of a data analyst 

e Convene and learn from other schools to disseminate 
best practices and share strategies for measuring impact 


'Ofe) | F-lele)e-ik-me) amd ar-la-ve| 


data resources 


e Solicit the expertise and resources of partners to build 
Leverage expertise credibility and strengthen value proposition based on 

iced ea ey-Vadalcya-Jallek-M- lave, existing research 

national associations 

See following page for examples of local and national partners 
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@) Data & evaluation: School leaders can leverage 
partnerships and national associations for expertise 


Capacity: Tools —_—| aTete) |S 


By leveraging partnerships and other existing resources regarding nontraditional school 


models, school leaders can avoid reinventing the wheel and minimize the need for 


| Meer] 
Organizations 


I FeLateyar- 
Ole F-Talye-1icelars 


Researchers, 
Peers, & 
Experts 


investing in internal capacity 


Regional charter networks that connect and support a range of charter schools (e.g., 
California Charter Schools Association, Northeast Charter Schools Network) 
Intermediary support organizations, funders, nonprofits, and thought leaders that 
influence local education (e.g., New Schools for New Orleans, Education Forward DC) 


National networks of charter school authorizers and/or school leaders (e.g., National 
Association of Charter School Authorizers, National Alliance for Public Charter Schools) 
National organizations dedicated to supporting high-quality implementation of 
nontraditional models 
o Inquiry-based schools: American Montessori Society, Association Montessori 
International/USA, National Center for Montessori in the Public Sector, EL Education 
o Dual language immersion/bilingual schools: Association of Two-Way & Dual 
Language Education; DC Language Immersion Project 
o Competency-based schools: Clayton Christensen Institute, The Learning Accelerator 


Leaders of other nontraditional schools to share and disseminate best practices 
Measurement and evaluation experts to create or improve model-specific metrics 


e State or local universities to enable data/evaluation expertise 


school leaders shared examples of leveraging 
stakeholders and experts to build authorizer awareness 


Capacity: Case Studies _| Case Studies 


Host authentic site visits 

to build authorizer awareness 
School Leader Challenge: 
The authorizer did not understand and 


misinterpreted a nontraditional charter school’s 
model during the renewal process 


School Leader Approach: 
The school leader of an inquiry-based school 


invited the authorizer for a site visit to help the 
authorizer become more familiar with the 
school model. The site visit highlighted key 
design features of the model. For example, 
given the emphasis of student-voice and 
student-led learning in this school, the tour was 
led by students 


“Our student-led tour has been incredibly 
effective. Our students can articulate answers 
far better than we adults do” - School Leader 


= Invest in research 
A’ to learn from data 
School Leader Challenge: 
The nontraditional school lacked the expertise 


and resources to develop valid, reliable, and 
attainable metrics for its model 


School Leader Approach: 

The school leader invested in a researcher to 
examine the school’s data. The school leader 
then shared the findings with the school board 
and authorizer. Findings were not incorporated 
into the performance framework, but they 
strengthened the school’s credibility, as well as 
the authorizer’s familiarity with the model 


“We hired a researcher to look at everything 
we're doing — the good, bad, and ugly. We 
realized that there were so many variables that 
go unnoticed” - School Leader 
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Additionally, partnerships have bolstered the case for the 
approval of several nontraditional schools 


~ Capacity: Case Studies _| Case Studies 


.. Partner with university to 
Hale] = build credibility & learning 


School Leader Challenge: 
The authorizer was unfamiliar with the school 
model and hesitant to take a risk on it 


School Leader Approach: 

The school leader experienced resistance in 
early conversations with the authorizer. The 
school leader looked for model-specific experts 
and forged a collaboration with a local 
university that was interested in researching 
the model. The university provided credibility to 
the school; the school provided the university 
with opportunities for research. 


“It was difficult to initially find an authorizer 
willing to take a risk on a new model. 
Ultimately, we got [a university] to sponsor us 
because of their knowledge and [interest in] 
research on our model.” - School Leader 


4 Solicit support from local 
nonprofits 


School Leader Challenge: 
The school leader lacked the resources to 
develop a compelling case about the model 


School Leader Approach: 

The school leader was new to the local charter 
landscape and solicited support from a local 
nonprofit organization. The nonprofit 
connected the school leader to school model 
experts and provided resources and 
recommendations on how to navigate the 
political landscape. 


“Oftentimes, school leaders of color might not 
have access to the playbook to get approved 
unless they had the opportunity to work with 
supporting organizations. It’s helpful to get 
support from local organizations to navigate 
the political landscape.” - School Leader 
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Standard performance metrics can be imperfect or 
incomplete measures of nontraditional schools’ quality 


Metrics: Description _| Description 


Imperfect or incomplete performance metrics: 

When school leaders are faced with standard performance metrics to assess school quality, 
they may find that the metrics conflict with their school’s instructional model (see slide 
13). In some cases, standard performance metrics may not accurately reflect the 
performance of nontraditional schools. In others, they may not effectively capture key 
features of a nontraditional school model. 


This can have at least four consequences: 

1. Nontraditional schools may experience competing priorities, between staying true to 
their model and meeting the demands of their authorizer 

2. Nontraditional schools may be incentivized to adopt practices in conflict with their 
model, in order to perform better on standard performance metrics 

3. When standard metrics do not accurately reflect their performance, nontraditional 
schools are more likely than others to be on the cusp of renewal and non-renewal 
and may find it more difficult to expand 

4. School leaders may struggle to translate success into metrics that fit their model, 
have credibility with the authorizer, and are accessible to families and the public 
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school leaders can choose to address challenges with 
metrics in several ways; each has benefits and trade-offs 


Metrics: Tools | 


Develop additional metrics, but keep them internal 


improvement of their model, but not share them with the authorizer 


Develop additional metrics, and share them with the authorizer 


Additional metrics can be shared informally, to build the authorizer’s familiarity 
with the model and inform their professional judgment on key decisions 


(1) School leaders may choose to develop additional metrics to guide continuous 


Additional metrics can be shared with authorizers, for formal accountability via 
schools’ performance contracts and high-stakes reviews 


There is no “right” answer. School leaders should carefully consider trade-offs and 


execute strategy with the expectation of making adjustments along the way. 


BELLWETHER 


EDUCATION! PARTNERS 23 


4) School leaders may develop additional metrics, but not 
share them with authorizers 


Metrics: Tools | eye) ks 
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* School leaders and staff have metrics necessary to * School leaders will need to commit resources to 
assess the implementation of the school model and develop high-quality metrics, as well as to consistently 
inform continuous improvement collect and monitor data over time 


School leaders and staff have metrics necessary to 
assess outcomes of the school model that are distinct 
from standard performance metrics 

The process of developing metrics can help school 
leaders codify their models, a prerequisite for eventually 
expanding or replicating their model 


| i -Xod aLote) M(-¥-(e(-] mera loles-t-1-m come(-n'4-) (eo) om-Lelelid(e)ar-]Min(:14a(ex-Mmm tal-)a-M-la-M-1 (Yom ol-Jal-1iitwr- lave mae-(e(-trel at) 


Ko) .¢-:) eliake Miat-Jermial<-daar-l 


* School leaders reduce the sense of external pressure * School leaders miss an opportunity to build authorizers’ 
that could lead them to make decisions based on the knowledge of the school model, and its distinct value add 
metrics instead of the model 

* School leaders maximize flexibility to adjust the model 
and metrics over time 
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(2) School leaders may develop additional metrics, and 
(3) consider the purpose of sharing them 


Metrics: Tools | aero) ks 
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¢ Authorizers better understand the school model, its ¢ Authorizers may not have the capacity or expertise to 
implementation, and distinct value add to families incorporate additional metrics into their decisions and 

* School leaders can demonstrate progress on practices 
additional metrics, in order to augment the information + Authorizers could begin to pressure schools on additional 
authorizers use to inform key decisions metrics, even if the metrics are not intended for 

* School leaders can communicate to authorizers the accountability 
school’s capacity and dedication to using data and ¢ Authorizers may perceive the school as trying to “explain 
evidence to inform continuous improvement away” or “dilute” standard performance metrics 


ih mr: Xo aloe) My Le(:) meq aloley-{-1-m vome(-\d-J(o)om-Lelelid(o)ar-] miat-10a (ex Mm alc) a-Mr-la-M el-dal-1ilcwe-lalemag-(e(-trey i i-wce) g 


Takexeya eXeler-lilave maal:anMiaiceM ce)gant-lmr-CexexelUlate-lelitiavmnar- Mm el-)ace)arar-lalex-Mere) alae: (eat-w-laleMal(elamcir-) (ct) 
reviews 


¢ Authorizers can conduct a more comprehensive * School leaders may find it difficult to change metrics 
evaluation of school effectiveness and key features * School leaders may find that sharing additional metrics 

* School leaders have additional incentives to prioritize adds unnecessary risk by increasing the number of 
delivering the distinct model they have promised to metrics the school must meet, especially if the school 
families and the community can/will perform well against standard metrics 
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(2) Additional metrics: Schools can develop additional 
(3) metrics that reflect their distinct outcomes 


Metrics: Toots | eye) ks 


Some schools may need to first 
invest in articulating their model 


How does the school’s ... 


e curriculum? 

e instructional approach? 
e school culture? 

e approach to talent? 

e school schedule? 

e external engagement? 
e other? 


.. support its distinct 
outcomes? 


Example: 
Students will receive 50% of 
instruction in Spanish 


Note: >1 element of school model 
may support a distinct outcome 


+e Start Here 


VAY ats lars Inomialsmcve alele) ks 


intended student outcomes 
that are not captured by 
Sits alors Kom anlelalexsie 


What student-level 
outcomes related to ... 


specific knowledge? 
executive function? 
social-emotional health? 
cultural awareness? 
other? 


... does this school’s 
model enable/support? 


Students will develop 
fluency in Spanish 


How will the school use ... 


e assessments? 

e student diagnostics? 

e student work portfolios? 
e student/family surveys? 
e other? 


... to set targets and 
assess progress toward 
outcomes? 


Students take 
Standards-based 
Measurement of Proficiency 
(STAMP) assessment 


What metrics indicate the 
school is delivering distinct 
outcomes successfully? 


How much will the 
outcomes improve, on 
what timeline? 


In creating additional 
performance metrics, school 
leaders must set goals for 
what they plan to achieve 
for their students 


90% of students who are 
enrolled from kindergarten 
will achieve fluency in 
Spanish by third grade 
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(2) Additional metrics: School leaders must ensure that 
(3) metrics are valid, reliable, and attainable 


Metrics: Toots | eye) ks 


WELiCeli ays 


Definition A metric is valid if the instrument 
measures what it intends to 
measure 


Guiding e Does the instrument measure 
Questions what you want it to? 
Is the metric a worthwhile 
indicator of learning or 
progress? 
Is the metric difficult to 
manipulate or “game”? 


Example 


Reliability PNiclarleyii a, 


A metric is reliable if it produces A metric is attainable if it uses 
consistent results under similar sources of information that are 
conditions (or can be) available 


e ls there sufficient sample Is there a measurement 
size? instrument or source of data 
e ls the data collection process that is a suitable input for the 
consistent? metric? 
Is there limited potential for Is there a reliable way to 
bias in how data is collected collect data, now and in the 
and analyzed? future? 


EVI Ce ig Reliable? Attainable? 


To evaluate a school’s progress toward its mission of environmental 
education, a metric is based on the number of bottles collected during 


a recycling drive 


To assess the quality of instruction, a school (or authorizer) uses a 
classroom observation rubric; however, evaluators who observe the 


same lesson rate it differently 


To measure long-term outcomes, a metric is based on students’ earned 
annual income 20 years after high school graduation 


Sources: The Graide Network, “Importance of Validity and Reliability in 
Classroom Assessments,” 2018; US Government Accountability Office, 


“Assessing Data Reliability,” 2019; TKI, “Reliability and Validity.” 
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(2) Additional metrics: School leaders should be mindful of 
(3) additional constraints for developing metrics 


Metrics: Tools| Tere) ks 


Additional Metric Considerations: 


Is there sufficient sample 
size? 


Is the metric consistently 
tracked over time? 


Does the metric use a 
consistent scale? 


Are there too many 
metrics? 


IWIN WAN 


Is the metric informing 
actions and decisions? 


KN 


Schools with smaller enrollment or analyses with smaller sample 
sizes may result in larger fluctuations in outcomes. Data with a small 
sample size can be supplemented with additional longitudinal data 


Ideally, metrics do not (or rarely) change. Consistent metric definition 
and collection enables year-over-year comparisons and learning for 


both authorizers and schools 


While rubrics or characteristics that becane Saal may y differ bie school 


model, metrics that have the same scale enables easier comparisons 


across schools and models 


The number corn metrics Bdiepeies on the number fot saniponeals ina 
school model. Authorizers and school leaders should prioritize quality 


of metrics over auanilty; and focus on what measures matter most 


A metric is sfasadinailll sal itit it is used dior: an intended purpose, SHA 
to inform continuous improvement. Authorizers and school leaders 
should consider removing metrics that are no longer used to drive 
actions or decisions 
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school leaders have used additional metrics to strengthen 
their case for their model and others’ understanding of it 


é) Supplement achievement 
x, metrics with growth 
School Leader Challenge: 

Standard performance metrics did not 


accurately reflect the performance of 
nontraditional schools 


School Leader Approach: 
A dual language immersion school was at risk 
for a nonrenewal due to reading performance 


of lower grade levels. They worked with their 
authorizer to supplement state assessment 
achievement data with normed referenced 
assessment growth information to make the 
case for student learning and progress toward 
proficiency 


“We worked with our authorizer to examine 
assessment outcomes like NWEA MAP, given 
that the state doesn’t have student-level 
growth scores” - School Leader 


(S) Use data to articulate 
pls effectiveness of the model 


School Leader Challenge: 

Standard performance metrics did not 
effectively capture key features of a 
nontraditional school model 


School Leader Approach: 

As part of the renewal process, the school 
leader provided research and data evidence to 
show correlation between elements of the 
school model and outcomes such as 
attendance or student engagement. The 
additional metrics and clear articulation of logic 
for the model, with clear input variables for 
success, strengthened the case for renewal 


“It’s important to show how components of our 
model connect, explain ‘This is why you’re 
seeing this, and this is how and why we’re 
doing this” - School Leader 
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Metrics: Case Studies _| Case Studies 
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In some instances, school leaders have chosen to keep 
metrics internal 


Metrics: Case Studies _| Case Studies 


al Protect internal learning metrics that evolve 


School Leader Challenge: 
While additional metrics may highlight school’s unique value proposition, 
additional requirements can also increase risks for closure 


School Leader Approach: 

A competency-based school leader considered incorporating additional metrics 
into the school’s charter. However, given the value the school places on the 
continuous improvement of its model, school leaders were hesitant — 
especially metrics related to inputs to the model or outcome metrics that might 
evolve. For example, students at this school invest time and attention on 
grade-level projects, but project specifications may change within a charter 
contract cycle. Additional metrics could put the school at greater risk of closure 
by creating more opportunities for the school to miss a target; codifying the 
metrics in its charter would also make it harder to adjust them over time. 


“The things we hold most dear, we don’t put in contracts. There is a risk that it 
would be under scrutiny with the state, that it can’t be changed, and we’re stuck 
for many years.” - School Leader 
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* 


Strategies & Considerations idole lanl oynod arate mc: 


Effective communication with key stakeholders is crucial for 
fostering nontraditional schools 


Communication: Description | 


Without effective communication strategies: 


School leaders may find that authorizers do not understand a nontraditional school’s 
value proposition or program designs. In addition, families and the community may 
find it difficult to discern what makes a nontraditional model different from other school 
options, struggle to assess a nontraditional school’s quality, and find it difficult to make 
informed decisions about where to enroll their children. 


This can have at least four consequences: 

1. Nontraditional school models may struggle to get approved in the first place 

2. Authorizers, families, and the community may not understand the value of a 
nontraditional school, or perceive the school as lower quality than it is 

3. Nontraditional schools may find it difficult to earn an authorizer’s endorsement 
for expansion; authorizers may be less likely to encourage them to grow 


4. Nontraditional schools may need to “defend” themselves against standard 
performance metrics 
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Proactive and effective communications can mitigate 
challenges before they surface 


Communication: Tools _| 


To improve or establish effective communications, school leaders can: 


(4) Use principles of strong communication to tell the school’s story 
(2) Build trust and collaboration with authorizer, with attention to timing 
3) Tailor and differentiate communications with authorizer staff and board 


(4) Engage families and the broader community 
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4) How school leaders communicate: School leaders can 
benefit from principles of strong communication 


Communication: Tools _| 


School leaders should consider the following best practices when addressing questions 
from authorizers and other stakeholders about their schools 
e Be proactive by communicating the value of the school to the authorizer, explaining 
the model, and anticipating and addressing authorizer questions 


e Build and lean on strong relationships with authorizer staff, local intermediaries, 
families, and other community partners to strengthen understanding of the school 


e Be evidence-based, and use research and knowledge from partner organizations to 
make the case for the school 


e Be transparent about areas where the school has demonstrated bright spots, as 
well as areas where the school is in a process of continued learning 


e Balance being comprehensive yet approachable to address questions for a wide 
audience; avoid jargon 


e Provide examples to ensure that abstract concepts are grounded in concrete 
illustrations of how the theory behind the school manifests in practice 
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4) What school leaders communicate: Articulating the model 
and intended impact will help school leaders tell their story 


Communication: Tools _| 


What is the unmet How will the school What impact will the Hou willtuGuskncine? 
need? address that need? r-Xoq aYolo) Ml at- MY= Wg y j 
Answering questions about the school’s mode! ... 


What elements of the How will you know 

school model are WHERE cRool whether the school 

designed to address : has achieved its 
model is successful? 


the problem? intended impact? 


What are the What will be different 
problems that the 


school will solve? 


... Will help school leaders tell their story 


Our school is We meet this need by OlnMmOuelilcreatee 
designed to address implementing a . : We know our model is 
learning environment 
an unmet need in the school model that working because ... 
; ; that enables ... 
community ... includes ... 
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@ When school leaders communicate: Being proactive, 


especially with the authorizer, pays dividends down the line 


Communication: Tools _| Bere) is) 


There are ongoing opportunities for school leaders to communicate proactively 


Authorizing Stage 


AV eo) o} [(er-1 ie) ammr-] 0) °) Ke] B 
late Med ar-lac-valare 


Monitoring reviews 


High-stakes reviews 


WM Kote l=1M => ¢ey-lar-yrey a 


Soft levers 


Sample Communications 


Begin conversations with authorizer about the nontraditional school model 
as soon as you begin to consider applying for a charter 


Learn about the application criteria, including the authorizer’s approach to 
nontraditional models, potential areas of flexibility, and non-negotiables 


Highlight and share rationale for anticipated outcomes, providing research 
or data where available 


Use consistent language and refer back to prior conversations, as needed 


Reference rationale, research, and data shared in prior authorizing levers 
Anticipate and advise authorizers if standard rubrics are a poor fit 


If growth is in your plan, have ongoing conversations with the authorizer 
on expansion plans, rationale, and how you will assess readiness to grow 


Include members of the authorizing staff on your school’s community 
outreach and other communications (e.g., family newsletter) 
Identify opportunities for families and students to convey key messages 
about the school model and quality 
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@ 


Authorizer staff and 
authorizer board members 
may have different priorities 
and needs. For example, 
authorizer staff may seek to 
limit risks while authorizer 
board may seek to accomplish 
political and/or community- 
oriented objectives. 


Considerations: 
e Who are my key 
stakeholders? 
e What are each of their 
primary objectives? 
e How do their objectives 
vary? 


School leaders can 
differentiate communication 
to meet the needs/interests 
of their stakeholders. For 
example, school leaders can 
speak more to quality metrics 
with authorizer staff and more 
to family demand with 
authorizer board. 


Considerations: 

e What data/evidence are 
relevant and compelling 
given the interest of this 
stakeholder? 

e How can | tailor 
communications to align 
my objectives with the 
incentives of my 
stakeholders? 


To whom school leaders communicate: Communications 
should be tailored for authorizer staff and authorizer board 


Communication: Tools _| Bere) is) 


Understand ene = 
stakeholders’ interests Utilize your network 


School leaders don’t have to 
navigate the landscape 
alone. School leaders can 
leverage school board 
members, community partners, 
and family advocates to 
brainstorm strategies and/or to 
provide additional voices in the 
conversations. 


Considerations: 

e Who are my advocates? 

e How can! leverage my 
network? 

e What perspectives can 
they add? 

e Who are the best 
messengers for what | 
need to convey? 


ro | 


(3) To whom school leaders communicate: Additional 
(4) communication strategies vary by stakeholder 


Communication: Tools _| Tools 
School leaders should tailor communications depending on whom they are addressing 


Audience 


Yo afelo) im (=tsle(=1n 
foxe)aalanlelayierstilelarsmyaival 
authorizer staff 


School leader 
foxe)aalanlelayiersii(eyarsmydiial 
FL Ui dale) apd: am oley-|Ke| 


School leader 
(exo)aalanlelalcer=1ece)arsmuyaital 
families & 
communities 


Strategies 


Clarify where traditional authorizing approach is (and is not) in conflict 
with your model, by sharing evidence-based rationale for model-specific 
nuances and by adhering to standard approach in non-model-specific areas 
(e.g., operations, finance) 

Collaborate with peer nontraditional school leaders, by sharing best 
practices and engaging in shared dialogues with authorizer 


Establish transparency, by proactively sharing knowledge and context of 
your nontraditional school model, including the approach and rationale of 
how authorizing tools and metrics may differ for your school model 

Build authentic engagement, by incorporating site visits and/or school 
model expert guest speakers to build the board’s awareness and knowledge 
of your nontraditional school model 


Protect student and public interests, by making student well-being the 
value informing all decisions and supporting parents and students in being 
well-informed about their quality of education 

Offer approachable information, by developing accessible and transparent 
communication and information channels (e.g., family newsletter, open 
house) 


Source: NACSA, “Principles & Standards for Quality 


Charter School Authorizing,” 2018. 
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At times, school leaders need to translate and articulate 
their school models for authorizers 


<= Document and share \ — Map standard requirements 
Lg alignment of curriculum [=| 7% to your school model 


School Leader Challenge: 
Authorizer did not understand how inquiry- 
based school ensured standards were taught 


School Leader Approach: 

To articulate curricular resource alignment with 
state standards, an inquiry-based school 
leader documented how teachers’ writing and 
planning are informed by standards, mapping 
out the process to help the authorizer develop 
an understanding of the rigorous approach. 
The documentation both informed the 
authorizer and was used as a resource for 
teacher professional development. 


“We had to prove we're still teaching 
standards, just in a different way. The 
documentations and sample lesson plans 
helped.” - Schoo! Leader 


School Leader Challenge: 

Authorizer did not see connections between 
competency-based checklists and the state’s 
credit hour requirements 


School Leader Approach: 

To demonstrate compliance in graduation 
requirements, a competency-based school 
leader worked to document and translate a 
graduation checklist aligned to credit 
requirements. The checklist is not sequenced 
(e.g., students don’t have to complete all of 
algebra before geometry), but the school does 
monitor progress toward completion. 


“We work on translation a lot. We spend time 
translating our checklist to credits for a 
transcript and use that to communicate to 
external stakeholders.” - School Leader 
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School leaders have implemented strategies to communicate 
effectively with families, as well as authorizer staff and boards 


Communication: Case Studies Case Studies 


ry Multichannel and frequent 
family communications 


School Leader Challenge: 

The public and families may not understand 
the nontraditional school’s value proposition or 
complex program designs 


School Leader Approach: 

To engage families, a dual language immersion 
school intentionally communicates using 
multiple channels. Weekly newsletters, 
monthly open parent meetings, and frequent 
calls home are all conducted in multiple 
languages. The school leader notes particular 
importance to communicate and engage 
families not yet familiar with the model. 


“We invest in many ways of communicating the 
right story to all constituents and don’t rely on 
one report to be the only narrative out there.” - 
School Leader 


Tailor communications with 
(MitY authorizer staff and board 


School Leader Challenge: 

Turnover or political changes within the 
authorizer board or staff may lead to different 
priorities that school leaders must navigate 


School Leader Approach: 

To navigate the political landscape, the school 
leader consulted with a school board member 
to map the priorities of the authorizer staff and 
board, including how they differ. The school 
leader then tailored talking points, intentionally 
elevating areas that are of interest to the 
specific stakeholder (e.g., highlighting strong 
family demand with authorizer board). 


“There can be a disconnect between advice 
that authorizer staff members give (and what 
their incentives are) and what authorizer board 
members want and need.” - School Leader 


BELLWE THER 


EDUCATION! PARTNERS 


40 


Appendix 


Acknowledgments 


We are grateful to the many individuals who shared their expertise and experiences regarding 
the authorization of nontraditional charter schools (unless otherwise cited, information is drawn 
from interviews with school leaders, authorizers, and other sector experts): 


Alex Alderman, Amy Quinn, Anna Hall, Arthur McKee, Bryan Hassel, Carrie Bakken, Charter School 
Growth Fund, Chris Pencikowski, Christie Huck, Dan McMinimee, Daniela Anello, David Noah, Don 
Soifer, Dr. Elizabeth Robitaille, Ed.D., Eric Klapper, Erin Kupferberg, Gregg Stevens, Heather 
Wendling, Jed Wallace, Dr. Julie Frugo, Ed.D., Karega Rausch, Katie Manthey, Kelli Peterson, Kim 
Carter, Kristen Forbriger, Kristine Barker, Kylie Holley, Lauren Holcomb, Lyria Boast, Magaly 
Rosario, Maquita Alexander, Matt Ladner, Melissa H. Silberman, Myron Long, Naomi Rubin 
DeVeaux, Nicole Caldwell, Peter Anderson, PK Candaux, Ryan Marks, Sara Cotner, Scott Pearson, 
Sherrie Gibney-Sherman, Sidnie Gallegos, Sonya Hemmen, Susie Carello, Terry Croy Lewis, 
Tomeika Bowden, and Vanessa Threatte. 


Bellwether Education Partners would like to thank the Walton Family Foundation for its 
support of this project. Any errors are the responsibility of the authors alone. 


Several examples included in this toolkit are drawn from Bellwether clients, a list of whom Is available on our 
website here: httos://bellwethereducation.org/who-we-work. 


BELLWETHER 


EDUCATION| PARTNERS 42 


About the authors 


Amy Chen Kulesa is a Senior Consultant on the Strategic Advising 
team at Bellwether 
She can be reached at amy.chenkulesa@bellwethereducation.org 


Ashley LiBetti is an Associate Partner on the Policy & Evaluation 
team at Bellwether 
She can be reached at ashley.libetti@bellwethereducation.org 


Juliet Squire is a Partner on the Policy & Evaluation team at 
Bellwether 
She can be reached at juliet.squire@bellwethereducation.org 


Justin Trinidad is an Analyst on the Policy & Evaluation team at 
Bellwether 
He can be reached at justin.trinidad@bellwethereducation.org 


Rebecca Gifford Goldberg is a Partner on the Strategic Advising 
team at Bellwether 
She can be reached at rebecca@bellwethereducation.org 


43 


